MASSIVE PRE-TRAINED LANGUAGE MODELS

Copied to clipboard

Challenge:	Existing studies on pre-trained language models for dialog reasoning fail to understand context correctly.
Approach:	They propose to use a crowd-sourced English task and a time-based task to test models' temporal reasoning abilities in dialogs.
Outcome:	The proposed task and crowd-sourced English challenge set show that even the best performing models struggle on this task compared to humans.

Papers with massive pre-trained language models